Skip Headers
Oracle® Enterprise Manager Cloud Control Getting Started with Oracle Fusion Middleware Management
12c Release 3 (12.1.0.3)

Part Number E24215-05
Go to Documentation Home
Home
Go to Book List
Book List
Go to Table of Contents
Contents
Go to Index
Index
Go to Feedback page
Contact Us

Go to previous page
Previous
Go to next page
Next
PDF · Mobi · ePub

26 Configuring and Monitoring Oracle Data Integrator

Oracle Data Integrator (ODI) provides a fully unified solution for building, deploying, and managing complex data warehouses or as part of data-centric architectures in an SOA or business intelligence environment. In addition, it combines all the elements of data integration - data movement, data synchronization, data quality, data management, and data services - to ensure that information is timely, accurate, and consistent across complex systems.

An ODI domain contains the ODI components that can be managed using Enterprise Manager. An ODI domain contains:

The Repositories and Agent pages display both application metrics and information about the Master and Work Repositories.

This chapter describes the set of typical tasks you need to perform when managing Oracle Data Integrator:

26.1 Setting Up ODI

Before you start managing ODI with Enterprise Manager, you must:

All the operations are available out-of-box in Enterprise Manager.

26.2 Accessing Oracle Data Integrator

To access Oracle Data Integrator (ODI), perform the following steps:

  1. From the Targets menu on Enterprise Manager, select Middleware.

  2. In the Middleware Features menu, select ODI Home.

  3. The ODI Home tab appears.

The regions on this page include:

26.3 Managing Oracle Data Integrator

The following summarizes the tasks to perform when managing Oracle Data Integrator components.

  1. Starting, Stopping, and Restarting Oracle Data Integrator Agents

  2. Managing Agent Status and Activities

  3. Search Sessions and Load Plan Executions.

    Navigate to the LPE/Sessions tab under ODI Home Page.

  4. Viewing Log Messages

26.3.1 Starting, Stopping, and Restarting Oracle Data Integrator Agents

To start, stop, and restart Oracle Data Integrator agents, use the Enterprise Manager Fusion Middleware Control Console.

26.3.2 Managing Agent Status and Activities

You can manage the agent status and monitor its activities.

The steps for this process are:

  1. Click the target link corresponding to your Java EE Agent either in the target navigation pane or in the ODI Master Repository Home Page. The Java EE Application Page for this agent appears.

  2. From the Agent Page menu, select Monitoring then select Performance Summary.

  3. The Performance Summary page opens. You can view and customize the displayed metrics and charts. How?

26.3.3 Viewing Log Messages

You can view log messages of Java EE agents in Enterprise Manager Cloud Control.

The steps for this process are:

  1. Navigate to the ODI Agent Home page.

  2. From the ODI Agent menu, select Logs then select View Log Messages.

You can filter the displayed log messages, for example by date range and message type and search for a search term in the message.

To configure the log configuration settings, select Logs then select Log Configuration from the ODI Agent menu.

26.4 Monitoring ODI Components

Oracle Data Integrator (ODI) provides a fully unified solution for building, deploying, and managing complex data warehouses or as part of data-centric architectures in a SOA or business intelligence environment.

In addition, ODI combines all the elements of data integration - data movement, data synchronization, data quality, data management, and data services - to ensure that information is timely, accurate, and consistent across complex systems.

Click the links for information regarding each of the tabs on this page.

26.4.1 Viewing General Health of ODI Components

ODI provides statistics summarizing the general health of the following components:

  • Master Repositories

  • ODI Agents

  • Work Repositories

  • Data Servers

Master Repositories Health

This section reports on the:

  • Number of master repositories that are either up or down. Click the number for a list of the repositories.

  • Master Repositories with Incidents. Click the number to find out which repositories have incidents.

To resolve issues reported in this section:

  • If the ODI repositories are down, act based on the statuses by either bringing up the repositories which are down or troubleshoot why they are down and resolve the issues.

  • If there are any repositories which are undiscovered, discover the repositories in Cloud Control.

  • If there are any repositories with alerts, identify the root cause for those alerts and resolve the issues.

ODI Agents Health

This section reports on the:

  • Number of Agents that are either up or down. Click the number for a list of the Agents.

  • Number of Agents that are not discovered as targets in Enterprise Manager. Click the number for a list of the Agents that have not been discovered.

  • Number of Agents with Incidents. Click the number to find out which repositories have incidents.

To resolve issues reported in this section:

  • If the Agents are down, act based on the statuses by either bringing up the Agents which are down or troubleshoot why they are down and resolve the issues.

  • If there are any Agents which are undiscovered, discover the Agents in Cloud Control.

  • If there are any Agents with alerts, identify the root cause for those alerts and resolve the issues.

Work Repositories Health

This section reports on the:

  • Number of work repositories that are either up or down. Click the number for a list of the repositories.

  • Number of work repositories that have not been discovered. Click the number of a list of the work repositories that have not been discovered.

  • Work Repositories with Incidents. Click the number to find out which repositories have incidents.

To resolve issues reported in this section:

  • If the ODI repositories are down, act based on the statuses by either bringing up the repositories which are down or troubleshoot why they are down and resolve the issues.

  • If there are any repositories which are undiscovered, discover the repositories in Cloud Control.

  • If there are any repositories with alerts, identify the root cause for those alerts and resolve the issues.

Data Servers Health

This section reports on the:

  • Number of data servers that are either up or down. Click the number for a list of the servers.

  • Number of data servers that have not been discovered. Click the number of a list of the data servers that have not been discovered.

  • Data Servers with Incidents. Click the number to find out which data servers have incidents.

To resolve issues reported in these sections:

  • If the data servers are down, act based on the statuses by either bringing up the data servers which are down or troubleshoot why they are down and resolve the issues.

  • If there are any data servers which are undiscovered, discover the data servers in Cloud Control.

  • If there are any data servers with alerts, identify the root cause for those alerts and resolve the issues.

Load Plan Executions/Sessions Quick Links

Click the links for details for each of the following:

Link Name Description
Sessions With Errors Number of sessions in error for this agent.
Sessions With Error Records Number of sessions with error records for this agent.
LPEs With Errors Number of load plan executions in error for this agent.
LPEs With Error Records Number of load plan executions with error records for this agent.

26.4.2 Viewing ODI Agents

This page has a table containing the following columns:

Agents

The Agents section displays the Agents declared in the Master Repository.

Element Description
Name Displays the name of the Agent. Select an Agent to display the corresponding Agent Home page.
Discovery Status A blue tick indicates that the ODI Agent is discovered as a custom target in Enterprise Manager.

A clock indicates that the ODI Agent is not discovered as a custom target in Enterprise Manager.

View Performance Click the eye glass icon to view the performance data of the Agent. The metrics include:
  • Maximum number of allowed sessions

  • Maximum number of allowed threads

  • Count of active sessions

  • Count of active threads

Active Sessions Displays the number of active sessions.
Master Repository A check mark acknowledges that this is a Master Repository.
Version Displays the version and date of the Agent.
Response Time (ms) Repository database response time in milliseconds.
User Defined Alerts Displays the number of Critical and Warning alerts. Click the number to view the alerts in the Incident Manager page.

Search Agents

Use this region to search for agents for all Java EE and Standalone agents.

The latest specified search criteria are always retained. Specify a new criteria and click Search to see the updated results. Or, click Reset to reset the search form (you must still click Search to see the updated results). Note that the search criteria are reset each time you log out or navigate away from all the tabbed pages of the Oracle Data Integrator Console application.

Element Description
Master Repository Select the Master Repository.
Execution Agent Select an Agent from the drop-down list. You can also select All to list all the Agents.
Agent Status Select the status of the agent: Up, Down, All.
Discovery Status Select the status of the agent: Discovered, Not Discovered, All.

26.4.3 Viewing Repository Details

The Repositories tab displays the following regions:

Note: Credentials have to be selected for this region to display.

Repositories

Element Description
Name Displays the name of the Work Repository.
Status Displays the status of the Work Repository database.
  • Up (green arrow): on

  • Down (red arrow): off

  • Not configured: the Repository is declared in the Master Repository but no connection to this Work Repository is declared in Oracle Data Integrator Console.

Host Displays the name of the host on which the repository resides.
Port Displays the port of the host on which the repository resides.
SID Displays the system identifier of the repository.
Version Displays the Repository version.
Response Time (ms) Repository database response time in milliseconds.
External ID Displays the ODI-specific unique identifier for the repository.
Incidents Displays the number of incidents associated with this repository: Critical or Warning.
Schema Name Displays the name of the schema associated with this repository.
LPE/Sessions Tablespace Total Rows and Segment Size in GB.
Purge Click the icon to purge the ODI logs. A separate browser window appears where you provide the required information, for example, purge type.

Database Details

By looking at the database details, you have a clear picture of how your database is performing. For example, if the Database Table Space is reaching near full, the Database Administrator can look at extending the table space.In addition, by taking a look at the database performance chart, Throughput and Wait bottlenecks sections, the Database Administrator can recommend fine tuning the database.

  • Wait Bottlenecks

    This section provides the following statistics: Average Instance (CPU%), Active Sessions Waiting I/O, and Active Sessions Waiting Others.

  • Throughput

    This section provides the following statistics: Number of Transactions per second, Physical Writes per transaction, Physical Reads per transaction, and User Commits per transaction.

  • Performance

    This section provides usage information for CPU, I/O Wait, and Others for the active sessions.

    Note: Credential and repository have to be selected for this region to display.

Tablespace Details

This section provides the growth rate for the tablespace by providing Space Used and Space Allocated statistics. Based on the information, you can decide whether to archive or purge the database data, or extend the tablespace.

Search Repositories

Use this region to search for repositories for all master and work repositories.

The latest specified search criteria are always retained. Specify a new criteria and click Search to see the updated results. Or, click Reset to reset the search form (you must still click Search to see the updated results). Note that the search criteria are reset each time you log out or navigate away from all the tabbed pages of the Oracle Data Integrator Console application.

Element Description
Repository Type Select the Repository type: Master Repository, Work Repository, All.
Repository Name Enter the name or a part of the Repository name.
Repository Status Select the status of the Repository: Up, Down, All.
Discovery Status Select the status of the repository: Discovered, Not Discovered, All.

26.4.4 Viewing Load Plan Executions/Sessions Statistics

The Load Plan Executions/Sessions displays the execution details of the Load Plan Executions and Sessions executed by the Agent.

Expand a session and review the Steps and Tasks information. For example if an ODI Interface was executed, you can review each task that this interface executed, view the generated code, and drill down to the database execution details.

Note:

Oracle Database Diagnostics and Tuning Packs are required to use the SQL Drill Down feature.
Element Description
Name Displays the name of the Load Plan Execution or Session.
Execution ID Load Plan Execution or Session identifier. Every time a Load Plan is executed, a new Load Plan Execution with a unique identifier is created.
Status Displays the status of the Load Plan Execution run or Session executed.
  • Running: The Load Plan Execution/Session is currently running.

  • Done: The Load Plan Execution/Session has terminated successfully.

  • Waiting: The Load Plan Execution/Session is waiting to be executed.

  • Error: The Load Plan Execution/Session has terminated due to an error.

  • Warning: The session has terminated successfully but erroneous rows were detected by an interface during flow control.

  • Queued: The session is waiting for an Agent to be available for its execution.

Started On Start date and time of the Load Plan Execution/Session run.
Updated On Displays the last updated date of the Load Plan Execution/Session.
Execution Time Displays how long it took the Load Plan Execution/Session to run.
Message Displays the error message of the Load Plan Execution/Session run, if any.
Error Records Displays the number of error records.
Execution Type Displays the type LoadPlan or Sessions, for example, Scenario.
Work Repo Name Displays the name of the Work Repository into which this Load Plan/Session run execution information is stored.
Agent Name Displays the name of the agent on which the Load Plan Execution/Session ran.
ODI User Displays the name of the ODI user who started the execution.

Search Sessions/LPEs

Use this region to search for sessions and load plan executions for all master and work repositories.

The latest specified search criteria are always retained. Specify a new criteria and click Search to see the updated results. Or, click Reset to reset the search form (you must still click Search to see the updated results). Note that the search criteria are reset each time you log out or navigate away from all the tabbed pages of the Oracle Data Integrator Cloud Control application.

Element Description
Master Repository Select the Master Repository containing the session information.
Work Repository Select the Work Repository containing the session information.
Execution Agent Select the Agent used to execute the session.
Context Select the session's execution context
Execution Type Select Sessions, Load Plan Executions, or All.
Begin Date Use the calendar icon to select a date at which to start the search for sessions. Only session started after this date will be returned
End Date Use the calendar icon to select a date at which to end the search for load plan executions and sessions. Only load plan executions and sessions ended before this date will be returned.
User Name Name of the ODI user who started the execution.
Status Select All or narrow the search to display specific statuses: Error, Running, Done, Warning, or Waiting. For example, you can select to view only Running and Warning statuses.
Message Error message of the Load Plan Execution/Session run.
Keywords Type keywords to narrow the search. When using multiple keywords, use a comma to separate each keyword, do not include spaces. For example use: lpe1,lpe2.
Execution Name Type the name of the load plan execution.
Error Records Select All or narrow the search to display load plan executions and sessions With Error Records or Without Error Records.
Execution ID Specific Load Plan Execution or Session identifier.

26.5 Monitoring Run-Time Agents

The Agents Home page enables you to monitor the Oracle Data Integrator run-time Agents. Both Standalone agents and Java EE Agents are ODI job executors. The difference between the two agents is that the Standalone Agents are non Java EE based and are managed through Oracle Process Manager and Notification Server (OPMN) or Common Administration Model (CAM) from Enterprise Manager. These run on the Jetty web server. Java EE Agents are Java EE based, that is, they are deployed on Oracle WebLogic Servers or IBM WebSphere. (IBM WebSphere is supported for ODI release 11.1.1.7 only).

Note: OPMN will be used to manage ODI standalone agents until ODI release 11.1.1.7. CAM will be used to manage ODI Standalone agents from ODI release 12c and later.

The Agent Home page is arranged in the following order:

General Info

The General Info region displays general information about this Agent.

Element Description
Status Displays the status of the Agent.
  • Up (green arrow): on

  • Down (red arrow): off

Response Time (ms) Displays the repository database response time in milliseconds.
Agent Version Displays the version of the Agent.
Host and Port Displays the host (network name or IP address) of the machine where the Agent has been launched on and the port on which the Agent is listening.
Master Repository Click to access the Database Performance page for the Master Repository.
Incidents An event or a set of closely correlated events that represent an observed issue requiring resolution through (manual or automated) immediate action or root-cause problem resolution.
More Information Click to browse for more information in the Oracle Data Integrator Console.

Target Incidents

The Target Incidents region displays notifications raised by the Agents attached to this Repository.

Element Description
Severity Seriousness of the incident.
  • Fatal - Corresponding service is no longer available. For example, a monitored target is down (target down event). A Fatal severity is the highest level severity and only applies to the Target Availability event type.

  • Critical - Immediate action is required in a particular area. The area is either not functional or indicative of imminent problems.

  • Warning - Attention is required in a particular area, but the area is still functional.

  • Advisory - While the particular area does not require immediate attention, caution is recommended regarding the area's current state.

  • Clear - Conditions that raised the incident have been resolved.

ID Incident ID.
Summary Summary description of the incident.
Category Classification of an incident, for example, Error.

Load Balancing Agents

The Load Balancing Agents region displays (if using ODI Load Balancing) the status and session metrics for the Agents declared as child Agents of the current Agent.

Element Description
Name Displays the name of the agent. This is the name you specified when you created the Agent in Oracle Data Integrator. Select an Agent to display the corresponding Agent Home page.
Status Displays the status of the Agent.
  • Up (green arrow): on

  • Down (red arrow): off

Discovered A blue tick indicates that the ODI Agent is discovered as a custom target in Enterprise Manager. Click the Agent name to access the ODI Console's Agent Detail Page.

A clock indicates that the ODI Agent is not discovered as a custom target in Enterprise Manager. Click the Agent name to access the Enterprise Manager Agent Target Page.

Originating LPEs/Sessions Displays the status of the LPEs and Sessions.
  • Error - Number of sessions in error for this agent.

  • Running - Number of sessions currently being executed by this agent.

  • Done - Number of sessions completed by this agent.

  • Warning - Number of sessions in warning state for this agent.

  • Waiting - Number of sessions waiting to be executed.

  • Queued: The session is waiting for an Agent to be available for its execution.

Avg Master Repo Response Time (ms) Displays the master repository database response time in milliseconds.
Sessions Maximum and Active number of sessions allowed on this Agent.
Threads Maximum and Active number of threads allowed on this Agent.

Load

The Load region displays the number of connections supported by the Agent over a period of time.

Elements Description
Maximum number of allowed sessions Maximum number of sessions allowed on this Agent.
Maximum number of allowed threads Maximum number of threads allowed on this Agent.
Count of active sessions Number of active sessions on this Agent.
Count of active threads Number of active threads on this Agent.

LPEs/Sessions Execution Incidents

The Load Plan Executions/Sessions Execution Incidents region displays notifications raised by the Agents attached to this Repository.

Element Description
Severity Seriousness of the incident.
  • Fatal - Corresponding service is no longer available. For example, a monitored target is down (target down event). A Fatal severity is the highest level severity and only applies to the Target Availability event type.

  • Critical - Immediate action is required in a particular area. The area is either not functional or indicative of imminent problems.

  • Warning - Attention is required in a particular area, but the area is still functional.

  • Advisory - While the particular area does not require immediate attention, caution is recommended regarding the area's current state.

  • Clear - Conditions that raised the incident have been resolved.

ID Incident ID.
Summary Summary description of the incident.
Category Classification of an incident, for example, Error.

26.6 Configuring Oracle Data Integrator Console

Oracle Data Integrator Console cannot be configured from Enterprise Manager Cloud Control. To make configuration changes you must use the Fusion Middleware Control Console. For information of how to configure Oracle Data Integrator, see Oracle Fusion Middleware Developer's Guide for Oracle Data Integrator.

However, you can configure Oracle Data Integrator Console from Cloud Control to define the linking between Cloud Control and Oracle Data Integrator Console.

By default, the fields on this page are populated with the Oracle Data Integrator Console host, the Oracle Data Integrator Console managed server port, and the default context root. If your Oracle Data Integrator Console must be accessed with a different configuration, you can change the configuration on this page.

The steps for this process are:

  1. Navigate to the Agent home page.

  2. From the Agent Page menu, select ODI Console Administration then select Basic Configuration.

  3. To modify the current configuration, enter new values in the following fields and click Apply.

    • Host: The name of the server where your application is deployed

    • Port: The HTTP listener port number

    • Context Root: The Web application's context root

    • Protocol: The protocol for the connection

    Click Revert to revert to the previous settings.

26.6.1 ODI Console Application Configuration Page

Use the ODI Console Application Configuration page to configure the connection to the Oracle Data Integrator Console Application.This page displays the current configuration for accessing the Oracle Data Integrator Console application. These values are automatically set when the application is discovered by Enterprise Manager and are used to access Oracle Data Integrator Console from Enterprise Manager, for example when clicking Browse.You can modify these values to access Oracle Data Integrator Console in a different way, for example to connect to Oracle Data Integrator Console by using a load balancer.

To modify this configuration, enter new values in the fields and click Apply. Click Revert to revert to the previous settings.

Element Description
Host Displays the name of the server where your application is deployed. If using SSO, enter the Oracle HTTP Server (OHS).
Port Displays the HTTP listener port number. If using SSO, enter the port of the machine where Oracle HTTP Server 10g or 11g Webgate is installed.
Context Root Displays the Web application's context root.
Protocol Displays the protocol of the connection

26.6.2 Configuring an Oracle Data Integrator Domain

Installing and configuring components for an Oracle Data Integrator domain is described in the Oracle Fusion Middleware Installation Guide for Oracle Data Integrator.